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Abstract. In this paper we consider a ring of A'^ > 1 queues served by a single server 
in a cyclic order. After having served a queue (according to a service discipline that may 
vary from queue to queue), there is a switch-over period and then the server serves the 
next queue and so forth. This model is known in the literature as a polling model. 

Each of the queues is fed by a non-decreasing Levy process, which can be different 
during each of the consecutive periods within the server's cycle. The A'^-dimensional Levy 
processes obtained in this fashion are described by their (joint) Laplace exponent, thus 
allowing for non-independent input streams. For such a system we derive the steady- 
state distribution of the joint workload at embedded epochs, i.e. polling and switching 
instants. Using the Kella-Whitt martingale, we also derive the steady-state distribution 
at an arbitrary epoch. 

Our analysis heavily relies on establishing a link between fluid (Levy input) polling 
systems and multi-type Jifina processes (continuous-state discrete-time branching pro- 
cesses). This is done by properly defining the notion of the branching property for a 
discipline, which can be traced back to Fuhrmann and Resing. This definition is broad 
enough to contain the most important service disciplines, like exhaustive and gated. 



1. Introduction 

Consider a queueing model consisting of multiple queues attended by a single server, 
visiting the queues one at a time in a cyclic order. Moving from one queue to another, the 
server incurs a non-negligible switch-over time. Such single-server multiple-queue models 
are commonly referred to as polling models. Stimulated by a wide variety of applications, 
polling models have been extensively studied in the literature, see 2^, 30, 31] for a series 



of comprehensive surveys and 2^, 3] for extensive overviews of the applicability of polling 
models. 

Throughout the vast polling literature, it is almost always assumed that customers arrive 
at the queues according to independent Poisson processes, where, in addition, the service 
requirements brought along by these customers are i.i.d. sequences; the resulting input 
processes in the queues thus constitute independent compound Poisson processes (CPPs). 
Correlated arrivals in polling models have received little attention; see Levy and Sidi [l9| 
for a treatment of polling models with correlated CPP input. Classical analysis of polling 
systems heavily focuses on keeping track of customers in the system at embedded epochs, 
i.e., instants of specific changes in the system, like polling instants or switching instants. 
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A key feature of polling models is the service discipline. A service discipline specifies the 
rule that determines how long a server will visit a queue (and process any workload found 
there). The most important and well known disciplines include the exhaustive discipline, 
gated discipline and 1-limited discipline. Under the exhaustive discipline, the server will 
stay at the queue until this queue has become empty. Under the gated discipline, the 
server serves exactly the customers (or: the amount of work) present upon the beginning 
of the visit. Under the 1-limited discipline, the server serves only one customer - if there 
is one. The 'system's service discipline' can be any 'mixture' of the individual disciplines; 
for instance: some of the queues are served according to a gated discipline, whereas others 
are served exhaustively. 

In Resing [i^] (see also Fuhrmann (l3 |) it is shown that for a large class of classical 
polling models, including those with exhaustive and gated service at all queues (but not 
1-limited), the evolution of the system at successive polling instants at a fixed queue 
can be described as a multi-type branching process (MTBP) with immigration. Models 
that satisfy this MTBP-structure allow for an exact analysis, whereas models that violate 
the MTBP-structure are considerably more intricate, and therefore usually intractable. 
It turns out that it is exactly the nature of the service disciplines which determines the 
MTBP structure of the system. The structure is preserved if each service discipline satisfies 
a special property called the branching property, see e.g. Property 1 of [23]. The exhaustive 
and gated disciplines do satisfy this property whereas the 1-limited does not. A key result 
for polling models with the MTBP structure is the joint steady-state distribution of the 
queue length (i.e., in terms of the number of customers) at polling or switching instants 
of a particular queue. 

In this paper we generalize the classical assumptions in several ways. We consider polling 
models with Levy-driven, possibly correlated, input streams. More specifically, we assume 
that the input process W is an A^-dimensional Levy subordinator, where > 1 corre- 
sponds to the number of queues, and where 'subordinator' means that the corresponding 
sample paths are non-decreasing (in all A^ coordinates). We refer to this model as a Levy- 
driven polling model with input process W. If the queue under consideration, say queue i, 
is not in service, its workload evolves according to the subordinator Wi(t), whereas during 
its service time it is described by Wi{t) minus drift t. It is important to note that, in 
fact, this paper considers a slightly richer class of models, in which the workload level 
while in service behaves as a spectrally positive Levy process Ai with negative drift (that 
decreases on average); here 'spectrally positive' means that the underlying process has 
positive jumps only. We remark that the class of spectrally positive Levy processes with 
negative drift is used frequently in the theory of storage processes to model the storage 
level (workload) of queues, dams or fluid models, see e.g. Kyprianou [3], and Prabhu [i^] 
for an early reference. 

We recall that Levy processes are processes with stationary, independent increments; it 
is stressed, however, that the components of the A^-dimensional Levy process need not 
necessarily be independent. The class of Levy processes is rich and covers Brownian 
motion, linear increment processes and CPPs as special cases. The generalization from 
CPPs to Levy input implies that we can no longer speak of notions such as customers 
and queue lengths; this explains why we focus on the (joint) workload process. While 
quite a few studies have been devoted to a single server single queue model with Levy 
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input (see, e.g., Prabhu [22, Chapter 4] and Asmussen [5|, Chapter 14] ) , there is hardly 
any hterature on Levy-driven poUing systems. An exception is Ehazar [13], who considers 
such systems only for the gated discipline, independent input processes and does not 
allow for spectrally positive Levy processes. His analysis follows a dynamical-systems 
approach: a stochastic Poincare map, governing the one-cycle dynamics of the polling 
system is introduced, and its statistical characteristics are studied. This approach differs 
from ours; we identify a branching structure in Levy-driven polling models as will be 
explained later. By considering the input as an A^-dimensional Levy process W instead 
of N one-dimensional processes Wj, we accomplish an easy incorporation of correlation 
between the inputs to different queues. This is due to the fact that every Levy process is 
uniquely characterized by its characteristic exponent, which in the multidimensional case 
also captures the correlation structure between the individual components. 
Considering polling models with Levy input opens several new perspectives. Firstly, the 
theory of Levy processes was strongly developed in recent years, and its application ap- 
pears to lead to more simplified derivations of many results which, for the case of compound 
Poisson input, are only obtained after detailed calculations. Secondly, having Levy input 
leads to significant generalizations of known results. Such generalizations are theoreti- 
cally interesting, but also, owing to the inherent flexibility of Levy processes, offer various 
new possibilities from the viewpoint of applications. Polling models have found applica- 
tions in many different areas, like (i) Maintenance (a patrolling repairman); (ii) Stochastic 
Economic Lotsizing (a machine producing products of various types upon demand); (iii) 
road traffic (traffic lights at signalized intersections); and (iv) protocols in computer and 
communication networks (Bluetooth; token ring protocols; protocols for web servers and 
routers). Almost invariably, it has been assumed in the polling literature that the input 
process is composed of a number of independent compound Poisson processes. We allow 
Levy input, and correlation between the various input streams, and different input pro- 
cesses during different visit and switch-over periods. This gives much additional modelling 
capability. E.g., in stochastic economic lotsizing it is quite natural to have correlations 
between the arrival processes of demands of different product types. And in road traffic 
as well as in communications, it is sometimes better to model traffic as a fluid than as 
separate customers; indeed, a special case of our model is the situation in which there is 
a constant fluid input in one queue of the polling model, and a compound Poisson input 
in an other queue. As another example, while a Brownian motion component may not be 
natural in representing work inflow, it may represent realistic fluctuations in the speed of 
the server. Recall that a served queue is modelled by a spectrally positive Levy process 
with negative drift allowing for incorporation of a Brownian component. 
The transition from CPPs to Levy subordinators deprives us from the possibility of using 
the branching property from Resing [iS] , which is stated in terms of customers (which are of 
a discrete nature) in the system, and therefore has no simple translation to our continuous 
state-space setting. In our paper we identify the analogous property, also referred to as 
the branching property, for the disciplines in the Levy framework, that enables to identify 
a branching structure in our system. This allows us to mimic Resing's approach, and 
to describe the multidimensional workload in the system at successive polling instants at 
a fixed queue as a multi-type continuous state-space (discrete time) branching process. 
This branching process is referred to in the sequel as multi-type Jifina branching process 



4 



O.J. BOXMA, J. IVANOVS, K.M. KOSINSKI, AND M. MANDJES 



(MTJBP) due to Jifina [16[, who introduced the notion of continuous state-space branching 
processes and paid special attention to discrete-time processes (cahed Jifina processes in 
the Uterature). The relation between Levy-driven polling models and continuous state- 
space branching processes has been observed before by Altman and Fiems [^J in a special 
case strongly relying on the assumption imposed that all the queues are fed by identical 
Levy subordinators. This relation was only used to derive the first two waiting-time 
moments and did not focus on the underlying structure of the branching process. The 
observation that Levy-driven polling models can be completely characterized (in terms of 
distribution) by a continuous-state space branching process of the MTJBP form is therefore 
novel. 

Another performance measure which is analyzed in the paper, again for disciplines satis- 
fying our new branching property, is the Laplace-Stieltjes Transform (LST) of the steady- 
state distribution of the joint workload in the queues at an arbitrary epoch. The classical 
polling literature focuses strongly on joint queue lengths at polling epochs, and contains 
results for marginal queue lengths and workloads at arbitrary epochs, but we are not aware 
of any general results for joint queue-length or workload distributions at arbitrary epochs 



- with the exception of the recent paper by Czerniak and Yechiali jl2l | that considers 
constant fluid input at all queues for a very special case of our model. We employ the 
Kella-Whitt martingale llTll to obtain this result. A similar approach has been used be- 
fore; e.g., Boxma et al. [lO| give the steady-state storage level transform for a Levy-driven 
queueing model with service vacations. 

Contribution. This paper casts a broad class of queueing models into a single general 
framework. More specifically the contributions are the following. First, we consider gen- 
eral. Levy-driven polling models instead of the classical models with CPP inflow. Second, 
we let the input W change at polling and switching instants, whereas in classical polling 
models the input processes are typically fixed once and for all. Third, we allow for corre- 
lation between the individual input processes (correlated arrivals received little attention 
so far, see 0]). Fourth, we introduce a new class of service disciplines satisfying a novel 
branching property, and we relate Levy-driven polling models to MTJBP. This class is 
broad and contains the well known exhaustive and gated disciplines. Fifth, we provide 
the LST of the joint steady-state workload distribution at an arbitrary epoch, which is 
a new result even for classical polling models. Finally, we show that the stability of our 
system does not depend on the disciplines used at different queues, and can be formulated 
in terms of rates of input (which leads to an intuitively appealing criterion). 

Organization of the paper. The remainder of this paper is organized as follows. In 
[Section "2] we describe the model and the service disciplines that are considered in this 
paper. [Section "31 presents a brief introduction on MTJBPs, and some additional intuition 
behind these processes. We also state a limit theorem for MTJBPs with immigration. 
[Section 4l contains one of the two main theorems in this paper. It is shown that in our 
model the workload level at different queues at successive epochs that the server reaches 
a fixed queue is an MTJBP with immigration. This leads to an expression for the LST of 
the stationary joint workload distribution at different queues at these epochs. [Section 5) 
contains the second main theorem of this paper. We derive the LST of the stationary joint 
workload distribution at an arbitrary epoch. In [Section 6[ we show that our results carry 
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over in a straightforward way to the situation in which W changes between pohing and 
switching instants. In lSection 7l we present a discussion of the ergodicity of the most general 
model, i.e., the model addressed in [Section 61 We conclude in [Section 81 by suggesting 
possible further generalizations. 

Notation. In the sequel, for any random variable X we denote its LST by X, i.e., X(u) = 
]gg-«v £qj. ^ g such that X exists. Throughout this paper, we will only use spectrally 
positive Levy processes, that is, processes which are allowed to have positive jumps only 
(and therefore containing the class of all aforementioned Levy subordinators). Recall from 
[Section l] that the class of spectrally positive Levy processes is used frequently in the 



theory of storage processes, see, e.g., [18|, I24]. For a background on Levy processes see 



e.g. [13, ]2M- Such a process {L(t),t > 0} can be uniquely characterized by its Laplace 
exponent: a function : M+ — > M say, such that Ee""-^^*) = e"*'^^"). 

To explicitly distinguish the multidimensional case from the single-dimensional case, we 
will use bold symbols to denote vectors and plain symbols to denote their coordinates, so 
that u = (ui, . . . ,Ud) for some d > 1. The inner product of two vectors u and v will be 
denoted by u - v. Finally, for a random vector X and multidimensional spectrally positive 
Levy process {L{t),t > 0} we define its LST and Laplace exponent analogously to the 
corresponding one-dimensional objects. All inequalities for vectors should be understood 
coordinate-wise. For sequences of one-dimensional objects we will use subscripts and write 
them as (a„), whereas in the multidimensional case we will sometimes use superscripts 
and write them as (a") to avoid double (or sometimes even triple) subscripts. 
As mentioned above, we focus on the system's workload process, and would like to show 
that it possesses a specific branching structure. To this end, we talk about children of a 
workload portion x. Because we can treat a portion of workload x as any number n of 
smaller portions x/n, we need to be able to talk about infinitesimally small portions of 
workload. That is why we shall adopt the language of fluid queues, and an infinitesimally 
small portion of workload can be regarded as a drop. Hence, from now on we shall use the 
terms workload and amount of fluid interchangeably. 

2. Model description 

We consider a system of N infinite-buffer fluid queues, Qi, . . . , Qjy, and a single server. 
The server moves along the queues in a cyclic order. When leaving Qj and before moving 
to Qj+i (where, by convention, Qn+i should be understood as Qi), the server incurs a 
switch-over period whose duration is a positive random variable Sj independent of anything 
else. Queues are fed by an A^-dimensional Levy subordinator W = {W{t),t > 0} with 
Laplace exponent (j)- The server's work at Qi is modelled by a spectrally positive Levy 
process Ai with negative drift (i.e., Ej4j(l) < 0), so that the work in the system evolves 
(while the server is at Qi) according to a Levy process 

Mt) := (Wi{t), W^.^{t), Ai{t), W^+^{t), M^jv(t)) • 

The Laplace exponent of Ai{t) is denoted through (j)f-{u). 

Remark 1. Taking a spectrally positive Levy process Ai rather than just a Levy subordi- 
nator Wi allows for usage of a slightly bigger class of input processes. For instance one 
can have a Brownian component as a component in an input process. The use of reflected 
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Brownian motion is quite common in queueing theory, as it is the Hmiting model for a 
w^e class of queueing models under the functional central limit theorem, see, e.g., Whitt 

Remark 2. In [Section 21 ISection 41 and ISection 51 the input process W remains fixed. In 
[Section "61 we show that one can still analyze the joint workload process if W is allowed to 
change at polling and switching instants. In classical polling models this could correspond 
to, e.g., having arrival rate Xij at Qi when the server is at Qj. 

The service disciplines that we consider in this paper satisfy the following property. 

Property 1. If the server arrives at Qi to find the workload level x there, then during the 
course of the server's visit, this workload is replaced by Hi{x), where {Hi{x),x > 0} is 
an N -dimensional Levy subordinator with Laplace exponent rji, which can be any Laplace 
exponent corresponding to an N -dimensional subordinator. 

In other words, if the server finds workload vector x at the time of arrival at Qi then 
the workload vector at the end of the service of this queue becomes x — XiBi + Hi{xi). 
Note that any replacement process should stay positive so that work does not become 
negative in Qi and does not decrease in the other queues. It is also obvious that such a 
process should be increasing in x. Therefore the assumption that Hi{x) is a subordinator 
is intuitively clear and natural. Moreover, due to the independent stationary increments 
property of any Levy process, we have that Hi{x + y) =d Hi{x) + Hi{y), where Hi{x) and 
Hi{y) are independent with the same distribution as Hi{x) and Hi{y), respectively (and 
'=d' denotes equality in distribution). Note that this properties essentially says that each 
drop of the fluid in the served queue is treated in an i.i.d. manner. It is further observed 



that Property 1 is a continuous analogue of the branching property from Fuhrmann 15| 



Note that we allow different service disciplines at different queues, as long as they obey 



Property 1 



Examples. It is readily verified that the important exhaustive and gated disciplines both 
satisfy [PropertyT! 



The gated discipline. Under the gated discipline, the server only serves the workload 
that was present at the start of the visit. Fluid flowing into the queue during the course 
of the visit is served in the next visit. Assuming (c.f., IRemark~3l below) that the server 
works with rate 1, i.e. Ai{t) = Wi{t) — t, and finds an amount of work x upon arrival, the 
time Ti{x) spent in Qi is simply Ti{x) = x, so that 

H,{x) = W{n{x)) = W{x) 

and 

(1) r]i{u) = (l){u). 

Remark 3. Observe that in the case of the gated discipline we assumed that Ai{t) = 
Wi{t) — t, so the workload level in Qi, during the server's visit, behaves as x + Wi{t) — t, 
where x is the starting level. This is a standard assumption in the theory of storage 
processes, although, in principle, Ai could be any spectrally positive Levy process with 
negative drift. Such processes are used frequently to model the workload level in fluid 
queues. The gated discipline, however, becomes ill-defined in such a general setting, thus 
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every time we speak of the gated discipline we tacitly assume that the server works with 
rate 1. 



The exhaustive discipline. Verification of the validity of Property 1 for exhaustive 
service is somewhat more involved. To this end, first recall that the server continues to 
work until the queue becomes empty. Fluid arriving during the course of the visit is served 
in the current visit. Let Tj(x) := mf{t > : Ai{t) = —x} be the time needed to empty 
the queue with initial workload level x. It is known that for Ai{t) a spectrally positive 
Levy process with negative drift, Tj(x) is an a.s. finite stopping time. Using the property 



of stationary and independent increments generalized to stopping times 18|, Theorem 3.1] 
one can see that Hi{x) is a Levy process. We need to compute 

Eexp{-u- Hi{x)) =Eexp - ^ UjWj {Ti{x)) 

\ 3+i 

which does not depend on Ui. Now consider, for a fixed vector it > 0, the function 
4'i,uiO) := 0^(ni, . . . , Ui-i,9, Uj+i, . . . , utv), where 6 > 0. It is easy to see that 4>i,u{0) > 
0, because Wj{t),j 7^ i are subordinators. Moreover, limg^ca 4>i,ui9) = —00, because 
Ai{t) is not a subordinator. It follows from the continuity of (j)i^u{(^) that there ex- 
ists a number ipi{u) > such that 4'i,ui'^i{u)) = 0. Then consider Wald's martingale 
exp(— M • Ai{t) + (l)f'{u)t) and pick ui = ilji{u). Application of the optional sampling the- 
orem to the a.s. finite stopping time Tj(x) gives Eexp(— X^j^i + '^iiu)x) = 1. 
Hence Ee-'"^'^^) = e'^'^'^)^ and 

(2) rji{u) = iJi{u). 

Mixed disciplines. For a fixed p € [0, 1] one can require that the fraction p of the present 
workload (upon arrival) is handled according to some branching discipline H^^^ and the 
rest according to a different branching discipline H^'^\ Then, 

Hi{x) =d H^^\px) + H^'^Xil - p)x) 

is a branching discipline. For instance, one can consider a p- exhaustive discipline, where 
it is required that the initial amount of workload x be reduced to the level px. Then, 

Hi{x) =d px + J/-haustive((-L _ ^^^^ 

is a branching discipline with Laplace exponent 
■r]i{u) = pui + ^i{u){l -p). 

Composition of disciplines. Because the composition of two Levy processes is again 
a Levy process, composition of two branching disciplines is again a branching discipline. 
In other words, one can consider a discipline, when upon finishing its service with initial 
workload level x according to a branching discipline H^'^^ (with Laplace exponent r/^^^), 
the server immediately starts to work again with initial workload level H^^x) according 
to a branching discipline H^'^'^ (with r/^^^). That is. 



Hi{x) = H^'^^ (h^^\x)') 
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is a branching discipline with Laplace exponent 

Naturally, one can think of the composition of more than two branching disciplines. 

General method. Recall that Ti{x) := inf{t > : Ai{t) = —x}. In the above examples 
we saw that as soon as we know the time Ti{x) < Ti{x) that the server spends serving 
Qi if it finds the workload level x upon its arrival, the replacement process Hi{x) can be 
written as xcj + Ai{Ti{x)). This relation will be further exploited in [Section 51 

3. Multi-type Jirina branching processes 

The observation that the theory of branching processes of Bienayme-Galton- Watson type 
can be extended to random variables taking their values in a continuous state-space appears 
to be due to Jifina [3], who points out that the key to such an extension is to make the 
offspring distribution infinitely divisible. The effect of an initial quantity of parent, may 
then be described by raising the Laplace exponent of the number of offspring per unit 
parent to the appropriate non-negative power; note the similarity with the discrete case, 
where the generating function of the distribution of offspring per individual is raised to a 
non-negative integral power. 

More formally, let {Rij,i,j > 0} be a sequence of integer- valued independent random 
variables, all distributed as R, and let {G, Gj,j > 1} be a sequence of i.i.d. integer- valued 
random variables. Then the Bienayme-Galton- Watson process with immigration is defined 

as 

Xn 

Xn+1 = ^ Rn+l,j + Gn+1, n = 0, 1, . . . , 

i=i 

where is a given (integer-valued) starting random variable. In the terms of LST's, we 
have 

E ) = {Ez'^f^Ez'^, \z\ < 1. 

Now consider an i.i.d. sequence of Levy subordinators {Rn{x),x > ,n = 1,2, . . .} char- 
acterized by a common Laplace exponent k and independent from {G,Gj,j > 1}. Then 
the sequence X„, where 

(3) Xn+l = Rn+l{Xn) + Gn+l, n = 0, 1, . . . , 

is called Jifina branching process with immigration. Note that every part of reproduces 
in an i.i.d. way, because Rn+i is a Levy subordinator. The distribution corresponding to 
K may be interpreted as describing the quantity of offspring per unit quantity of parent. 



Models of this type have been analyzed in various papers, see e.g. [2l|, |26|, l23]- Finally, 
observe that from ([3]) it follows that 

(4) E (e-"^"+i = e-^"'^(")G(n), u>0. 

This relation expresses what has been said in the first paragraph of this section. 
In a natural way this concept extends to the multi-type case, where each type reproduces 
independently from others and gives rise to a multi-type population. For i = 1, . . . ,N, 
let {Ri, R'^{x),x > 0, n > 0} be mutually independent sequences of i.i.d. A^-dimensional 
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Levy subordinators with Laplace exponent Kj, and let {G,G"',n > 1} be a sequence of 
non-negative A'^-dimensional i.i.d. random vectors. We define the one-step evolution of the 
process X through 

N 

(5) = R7^Hx?) + 

i=l 

where and are assumed to be independent of J-^ and X is a given starting 

random vector. Equation then becomes 

(6) E (e— = e-^"-(")G(^). 

Such a sequence will be called a multi-type Jifina branching process (MTJBP) with branch- 
ing mechanism k and immigration G. 

Let TTij j be the expected quantity of type j offspring per unit quantity of parent population 
of type i, i.e. 

mij = ER,j{l) = ^(0). 

An essential role is played by what we will call the mean matrix M = {mij)ij=i^,,,^]sf. Note 
that M is a non-negative matrix, so by the Perron-Frobenius theory the spectral radius 
Pm of M is an eigenvalue such that any other eigenvalue is strictly smaller in absolute 
value. 

Define inductively by k^^\u) = u and k^^\u) = k^^~^\k{u)), for i = 1,2,.... 

Finally, let || • || denote any norm on M^. 

Theorem 1. Let \\G\\ be integrable then the following holds 

• if Pm < 1 (subcritical case) then X"' converges in distribution to a random vector 
X°° G satisfying 

oo 

(7) Ee-""-^^ = II u>0; 

k=0 

• if Pm > 1 (supercritical case) and Gi > with positive probability for all i then 

— )• oo a.s. as n oo. 

We remark that the case of pM = 1 is substantially more involved and its treatment is 
beyond the scope of this paper. 

Proof The first claim follows from [3']. We prove the second claim. Let i; be a non-negative 
eigenvector associated to pM > 1; such a vector exists according to the Perron-Frobenius 
theory. Note that Ki{9v) as a function of 9, is the Laplace exponent of the Levy process 
V- ]ii{t), and hence it is concave with derivative at equal to . . . , mi^]\f) ■ v = pMVi > 

Vi. Hence we can choose 9* > such that Ki{9v) > 9vi for ah 9 £ [0,9*]. Let 9* > he 
the minimum over 9*, then 

(8) k{9*v) > e*v. 
Combining ^ and ([5]) we get 

< Ee-^*^-^"^' < Ee-'^*^-^"G(0*i?) < {G{9*v)Y+^ 
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as n — )• oo, because Ee ^ < 1. Hence 9*v ■ X" — )• oo and so also ||X"|| oo with 
probability 1. □ 

It is easy to see from the final part of the proof that the additional condition in the 
supercritical case, namely Gi > with positive probability for all i, can be substituted 
with the following one. It is enough to assume that |[G|[ is not identically and there 
exists a positive vector v such that Mv > v. It is known that such a vector exists 
if M is irreducible. We do not assume irreducibility of M, because our polling system 
with exhaustive discipline at the A^-th queue will correspond to a matrix M which is not 
irreducible. We elaborate more on the stability issue in [Section 7l 

4. Polling systems and multi-type continuous-state branching processes 

In this section we shall prove that for our model the amounts of fluid in the queues on 
successive epochs that the server reaches Qi form an MTJBP with immigration, which is 
one of the main results of this paper. Define t„ as the (random) time point that the server 
reaches Qi for the nth time. Let to correspond to time 0. 

Theorem 2. Consider a polling system from \Section S\ with switch-over times Si. Assume 
that the service discipline at Qi satisfies \Property^ with Laplace exponent r]i, i = 1, . . . , N . 



Then the amount of fluid in the different queues at time points tn constitutes a multi- 
type Jifina branching process with immigration, where the branching mechanism k is given 
by the recursive equations 

(9) Ki{u) = r]i{ui, . . . ,Ui,Ki+i{u), . . . ,kn{u)) , i = l,...,N, 

and the immigration LST G{u) is given by 

N 

(10) G{u) = W^Si {(piui, ...,Ui, Ki+l{u), KNiu))) ■ 

i=l 

We tacitly assume that kn is read as rj^, the argument of Sn in ^TO\i is (j){u) and 
is a given starting distribution. Importantly, an immediate consequence of [Theorem 21 is 
that we can use [Theorem II to obtain the limiting (steady-state) distribution of the joint 
workload B°° at polling epochs for our polling model, cf. ([7]). 

Proof Consider the polling system at time t„. and assign the color Cj to the fluid in Qi 
and denote its amount through Xj, for all i = 1, . . . , A^. Now suppose that fluid arriving 
during switch-overs has color cq, and fluid arriving during the service of Cj-colored fluid 
has the same color q for alH = 0, . . . , A^. We stress that our coloring depends on the color 
of the fluid in service, i.e., not on the queue. Given Xi - the amount of fluid of color Cj at 
time tn, denote the amount of fluid of color Cj at time tn+i through R^'^^{xi) (offspring of 
type i) if i ^ 0, and Q^~^^ (immigration) if z = 0, so that 

N 

(11) = ^^^^(^^") + n > 0. 

i=l 

Obviously the sequences {Rf{x),x > 0,n > 1} and {G",n > 1} constitute sequences of 
i.i.d. increasing stochastic processes and random vectors, respectively. Moreover, is 
independent from for i = 1, . . . , N , because the amount of fluid arriving during switch- 
over periods depends only on the lengths Si (independent from anything else) of those 



LEVY-DRIVEN POLLING SYSTEMS 



11 



periods and the input process W, but not on the amount of fluid already in the system. 
Denote the common distribution of {R^{x),x > 0,n > 1} and {G"',n > 1} by Hi and G, 
respectively. 

Note that at the time instant when the server starts polling Qi+i, the amount of fluid of 
color Ci is given by Hi{xi), so 

i N 

(12) Ri{xi)=AYejHi^j{xi)+ Rji^ijixi)), 

j=l j=i+l 

where Hij{x) denotes the jth element of Hi{x). Note that the color Cj fluid can appear 
in the system only as a replacement of the fluid already present in Qi at the beginning of 
the polling cycle (which corresponds to the part Y2]=i ^jHij{xi)), or as a replacement of 
the fluid that arrived to the, yet to be served, queues Qi+i-, ■ ■ ■ ,Qn, during the service of 
Qi (which corresponds to the part X^^j+i Rj{Hij{xi))). 

Backward induction (from i = N toi = 1) and stationarity and independence of increments 
of Hi imply the same properties for Ri. Hence, Ri are Levy subordinators, for i = 
1,...,N. Finally, the mutual independence of Rf for i = 1,...,N follows from the 



Property ![ Hence > 0} is a MTJBP. 



Next, we compute the Laplace exponent Ki of Ri. Using (fT2]) and conditioning on Hi{x) 
we obtain 

(i N 
— 'Y^UjHij{x)— Y^ Hij{x)Kj{u) 
j=l j=i+l 

= exp {-xrji{ui, ... ,Ui, Ki+i{u), . . . ,KAr(u))) , 

so that Q holds. 

It is left to compute the LST of G. First note that we can write G = Y2i where Gi 
are mutually independent and represent fluid at the end of the polling cycle generated by 
the ith switch-over. That is, 

i N 
=d J^e,VF,-(5,)+ Y Rj{Wj{S,)). 

j=l j=i+l 

Similarly as above we obtain 

(i N 
-J2ujWj{Si)- Y Wj{Si)Kj{u) 
j=i j=i+i 

= Eexp {-Si(j){ui, ...,Ui, Ki+i{u), . . . , KNiu))) , 

which proves (fTUj) . □ 

Let Bi and Ei denote the random variable having the steady-state distribution of the joint 
amount of fluid in each queue at the beginning of a visit (polling instant) to Qi and at the 
end of a visit (switching instant) to Qi, respectively. 
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Corollary 1. Bi and Ei can be related to each other by 

(13) B,+^{u) = Eiiu)Siicl){u)) 

and 

Ei{u) = Bi{ui, . . . ,Ui-i,r]i{u),Ui+i, . . .,un), 

where 

oo 
k=0 

with G and k given bv \Theorem 2 . 

Remark 4. By the same token, we can, for arbitrary i = 1,... ,N, find Bi{u) as well 
(renumber such that Qi becomes Qi). The infinite product formula for the Laplace trans- 
form of the distribution of Bi is typical in the area of (classical) polling models. This kind 
of formula can be numerically inverted to obtain various performance metrics, see Abate 
and Whitt Q, 3 and Choudhury and Whitt Such an infinite product already arises 



in the case of a M/G/1 queue {N = 1) with gated vacations. For example [28, Section 2.5, 
Formula (5.19)] gives the following relation for Q{z), the generating function of the queue 
length distribution at the end of a vacation: 

Q{z) = Q{B*{Xil-z))V*{X{l-z)), 

where A denotes arrival rate and B*{-), V*{-) are the LST of service time and vacation 
length, respectively. This immediately results in 

oo 

Q(z) = n^*(A(l-5«(^))), 

i=0 

where 5W(z) = B* {X{1 — 6^'^^^\z))) , i = 1,2, . . . , 6^^\z) = z. In the special case of a single 
queue (A^ = 1) and exhaustive service, the infinite product degenerates to V*{X{1 — z)) 
because at the end of each visit, the system has become empty. 

For arbitrary N and classical Poisson input processes, Resing [23] presents the joint queue 
length generating function at epochs the server begins a visit to Qi. This generating 
function is also given in the form of an infinite product, cf. fisl. Theorem 1 and Theorem 
3]. 

Remark 5. The interpretation of the above infinite-product expression for Bi{u) is the 
following. The terms of the infinite product correspond to independent contributions to 
the workload vector at a polling instant of Qi- The 0th term represents work still present, 
that has arrived during the switch-over periods in the cycle that has just ended. The 1st 
term represents work that has arrived during the service of work that had arrived one 
cycle earlier during switch-over periods. And so on: the kth term. A; = 1, 2, ... , represents 
work that was initiated k cycles before the last cycle by ancestral work arriving during a 
switch-over period. 

Remark 6. A special case of our model is the fiuid polling model studied in Czerniak and 



Yechiali [ij]: there the Levy input reduces to linear deterministic processes. Another 
special case of our model is the classical polling model in which the Levy input corresponds 
to A^ independent CPPs. 
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Remark 7. From the proof of lTheorem 21 we can clearly see the importance of the branching 
property. Most importantly, it implied the distributional equality p2|) for the distribution 
of Ri. Then the distribution of G follows in terms of the Laplace exponents of the Ri S. 
However, to establish the MTJBP structure of the Levy-driven polling system, all we need 
to show is that (fTTjl (or equivalently ([5])) holds with independent components. 
One can think of disciplines that do not satisfy [Property 1[ but for which still the work- 
load evolution can be described by (jlip . An example is the globally- gated discipline (see 
0]), which works as follows. At the beginning of each cycle, all fluid in Qi, ■ ■ ■ ,Qn is 
marked. During the next cycle, the server serves all the marked fluid. The newly ar- 
rived fluid, however, has to wait until being marked at the next cycle-beginning, and will 



be served during the next cycle. This discipline does not satisfy Property 1, but assum- 
ing that the server works with rate 1, an equation of the form (jlip can be derived with 
R^ =d W and G = X^Gj, where Gi =d W{Si). Therefore such a model also has the 
MTJBP structure with branching mechanism k,(u) = {cj){u), . . . ,0(u)) and immigration 
LST G{u) = llS^i(f>{u)). 

As in the introduction, it should be noted that a relation between Levy-driven polling 
systems and continuous-state space branching processes was considered before by Altman 
and Fiems [3]. In that work, the assumption is imposed that all queues are fed by identical 
Levy subordinators, and it is precisely this assumption that enables the construction of 
a continuous state-space branching process. Moreover, the relation in [4] is used only 
to derive the first two waiting-time moments and not to determine the structure of the 
branching process itself. 

5. Steady-state distribution at an arbitrary epoch 

Having determined the LST of the joint steady-state workload at polling and switching 
instants in the previous section, we now concentrate on its counterpart at an arbitrary 
instant in time. It should be noted that this distribution was not even found before 
for the classical polling models with independent CPP inputs, except for the marginal 
distributions. In order to do so, we need to make the notion of service disciplines more 
precise. 

Firstly, recall that work in the system (while the server is at Qi) evolves according to a 
Levy process 



Mt) := (Wi{t), Wi.iit), Ai{t), W^+l{t), WN{t) 



where Ai{t) can be any spectrally positive Levy process with negative drift. The Laplace 
exponent of Aj(t) is denoted through 4>f-{u). Let Ti be an augmented right-continuous 
filtration, such that Ai{t) is a Levy process with respect to Ti (one can take an augmented 
natural filtration of Aj(t), t > 0). Let rj(x) denote the time the server spends at Qi when it 
finds X units of work in this queue upon arrival. Loosely speaking, Tj(x) is a stopping rule 
for the server, which observes the process Ai{t). This motivates the following assumption. 

Assumption 1. Ti{x) is an J^i-stopping time for every x. 



Assumption 1 ensures that the disciplines are 'non-anticipating'. For example, we exclude 
the cases, when the server decides to stop the service if it 'sees' that, for instance, the 
cumulative input in the next T units of time is less than some e. The above assumption 



14 



O.J. BOXMA, J. IVANOVS, K.M. KOSINSKI, AND M. MANDJES 



expresses the fact, that a service strategy or discipHne should be based only on the knowl- 
edge of the evolution of the system up to the current time-point. Observe that for the gated 
discipline Ti{x) = x and for exhaustive rj(x) = Ti{x) = inf{i > : Ai{t) = —x} (recalling 
the definition of Tj(x) from [Section 2p . It is easily verified that both are J^j-stopping times, 
as desired. 

We also require that a discipline is 'work conserving', that is, the server never stays at a 
queue after it became empty. This is made precise in the following assumption. 

Assumption 2. For every x it holds that Ti{x) < Ti{x) a.s. 

Note that the gated discipline {Ai{t) = Wi{t) — t) and the exhaustive discipline are always 



work conserving. Because of Assumption 2 one does not need to consider reflection of the 



workload process at 0, hence the workload replacement Hi{x) is given by 

Hi{x) = XBi + Ai{Ti{x)). 

Moreover, E,Ti{x) < 'ETi{x) < oo, because Ai{t) has negative drift. Hence using Wald's 
identity twice to Levy processes Hi and Aj we get 

(14) Et,{x) = xEnil). 

The following result presents a Kella-Whitt type martingale, which is a key tool in deriving 
the workload LST at an arbitrary time. 

Proposition 1. 

Mi{t) := e-'^-^'W - 1 + 4>f{u) f g-^'^'^^) ds, t > 0, 

Jo 

is a zero mean martingale with respect to filtration Ti. 



Proof Apply Kella and Whitt 17|, Theorem 1] to the one-dimensional Levy process u ■ A. 



(with respect to filtration J^j). □ 



Applying Doob's Optional Sampling theorem to the martingale Mi from Proposition 1 and 
stopping time rj(x) A n yields 



E 



/•Tiix) An -I 

Jo <Pt{u) V ; 



Taking n — > oo and applying the monotone convergence theorem on the left and the 
dominated convergence theorem on the right (e~"'^«('^«(^')/\") < ^Uix^ obtain 

fTiix) 



(15) E e-'^-^'(")ds = ^— Efl-e-"-^"(^'(^» 

Jo <Prw ^ 

We are now ready to state the second main result of this paper. 
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Theorem 3. Consider the polling system described in \Section~^ and suppose that the 
disciplines at every queue satisfy \Assumption 1 , Assumption S\ and Property 1 Then the 
LST of the steady-state distribution of the joint amount of fluid F at an arbitrary epoch 
is given by 



(16) Ee 



-u F _ N{U) 



N N 



i=l 1=1 

where 

N 



Bi{u)-E,{u) , Ei{u) - Bi+i{u) 



i=l 



(pt{u) 0(w) 



and Bi, Ei are as given in Corollary 1 



Proof Let F{t) be the amount of fluid in each queue at time t within a cycle C, assuming 
that we start in stationarity. The LST of F is calculated by dividing the expected area of 
the function ^-'^-^i^) over the cycle C, by the expected cycle time EC: 



rC 



F{u) 



EC7 
Note that 

TV 

C=AY.^Si + Ti{Bi^i)), 

i=l 

from which, in combination with (|14p . the denominator in (|16|) follows. 
An arbitrary cycle of length C can be divided into intervals corresponding to visit periods 
Vi to Qi and switching (idle) periods Ij between Qi and Qi+i- Conditioning on Si and 
using Fubini's theorem, we find 



Si{u) := E /" e-"-^(*) dt = E [ ^ ^-uiE,+w(t)) ^ ^.^^^ 
Jli Jo 

^ Ejju) - Bi+i{u) 

On the intervals Vi we have 

Ci{u) :=E /" e-'^-'^W (it = E r''^^'^\-''<^^+^^^'^Ut. 
JVi Jo 

Conditioning on Bi and applying (|15p yields 



= -J— (Ee-^' - Ee-^>) = ^-^^^f ^^^^^ 
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Finally, 



E / e-'^-^W di = iZ + Si{u)) 

Jo 



i=l 

□ 

Note that all the quantities appearing in the statement of lTheorem 31 are computable, in 
the sense that they follow from the results presented in [Section 41 the transforms Bi{u) 
and Ei{u) are given in Corollary 1 and Ei?j^j = —dBi/dui{0). 

6. Varying input processes 

In lSection 2l and lSection"4l we considered a polling model, with fixed input W characterized 
by its Laplace exponent (j). However, to derive our results, all we needed was the knowledge 
of (f) and 0^ for i = 1, . . . , N as remarked at the end of [Section 21 and not the fact that (f>^ 
are related to each other or that <f> is fixed. That is why we can allow our input to change 
between embedded epochs. 

More precisely, let Wi and Wi be sequences of A^-dimensional subordinators for i = 
1, . . . ,N. When the server arrives at Qi then the input process changes to Wi, and when 
the server leaves Qi the input process switches to Wi. Let us denote the Laplace exponents 
of these processes by (pi and cpi, respectively. The process Ai{t) becomes 

Ai{t) := (Wi,i{t), . . . , Wi,i.i{t), Ai{t), Wi,i+i{t), . . . , Wi,N{t)) , 

where Ai(t) is an arbitrary spectrally positive Levy process with negative drift modelling 
the server's work at Qi. Again, denote the Laplace exponent of Aj by (^^. 
We still consider disciplines satisfying Property 1 so that for the gated discipline ([T|) 
changes to 

r]i{u) = (j)i{u), 

and for the exhaustive discipline ([2]) changes to 

7]i{u) = tpiiu), 

with ipi such that (pi,u{'^i{u)) = for (pi^uiO) = (pfiui,...,Ui-i,9,Ui+i,...,UN), where 
6 > 0. The resulting process {-B",n > 1} of the joint amount of the fluid in the different 
queues at time points t„ also constitutes an MTJBP with branching mechanism k given 
by Q and immigration LST given by 

N 

(18) G{u) = JJS'i((^i(ni, . . . ,Ui,Ki+i{u), . . .,KNiu))) 

1=1 

instead of (jlOp . The argument given in the proof of lTheorem 21 stays valid. Then (jl3p in 



Corollary 1 changes into 



(19) B,+i{u) = Ei{u)Si{Mu)). 

The statement of lTheorem 31 also still holds with 

^ A / Bi{u)-E,{u) E.ju) - Bi+,{u) 
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Remark 8. For independent compound Poisson input processes, the case of varying input 
has been studied in [7| . There it is assumed that the arrival process at Qi , when the server 
is at Qj , is a Poisson process with rate \ij . Under the assumption of branching- type service 
disciphnes, the joint queue-length distribution at polling instants is derived in [71]. 



7. Ergodicity 

Consider the polling model with varying input, as was presented in lSection 61 The stability 
condition of such a system is given in terms of the Perron- Frobenius eigenvalue pM of the 
mean matrix M associated to a certain branching process, see [Theorem II This branching 
process in turn is specified in lTheorem 21 (or. more precisely, in its generalization to varying 
input, as presented in [Section "51) in terms of r]i among other quantities. This leads to a 
rather non-transparent stability criterion, as opposed to the 'p < 1' type of criteria one 
usually encounters in queueing theory. In addition, it is not clear how the criterion depends 
on the disciplines used at different queues. The goal of this section is to make the stability 
condition more explicit, and to show that it is, under quite general circumstances, not 
affected by the service discipline. 



In this section we assume that the disciplines at all queues satisfy Assumption 1 and 



[Assumption 2 Moreover, we exclude the degenerate case when Ti{x) = (never serving 



Qi). In this setting the stability condition can be greatly simplified. Importantly, we 
show that it can be expressed in terms of properties of the rate matrix A = {aij) rather 
than properties of the mean matrix M; here aij = KAij{l), that is, Uij is the rate of the 
work evolution at Qj while the server is at Qi. Note that A has non- negative off-diagonal 
elements, hence by Perron-Frobenius theory it has a real eigenvalue pA which is larger 
than the real part of any other eigenvalue of A. 



Lemma 1. Let A be irreducible. Then it holds that 

• if Pa < then pM < 1 (subcritical); 

• if PA = then pM = 1 (critical); 

• if PA > then pM > 1 (supercritical). 

In the supercritical case there exists a positive vector w such that Mw > w . 

Proof Let us consider the polling model from [Section 61 and denote the MTJBP associated 
to it by {B^). This MTJBP has a corresponding branching mechanism k and immigration 
G. Let us construct a new MTJBP (-B") with the same branching mechanism k but 
without immigration, i.e., with G set to 0. Such an MTJBP obviously corresponds to a 
polling model with the same characteristics as the starting model, but with switch-over 
times set to 0. Moreover the mean matrix M is the same as the mean matrix M. 
From the definition of M its ith row is given by m-i = E (S^|B° = Sj). In the following 
we assume without loss of generality, that = Cj. We can write 



N 

B^ = ei + Y,Ak (TkiFk)), 

k=i 
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where denotes the fluid in Qa: upon the server's arrival to this queue (in the first cycle). 
Using Wald's identity and the linearity of ETfc(a;), as given in p4|) . we obtain 

N 

rrii = EB^ = + ^ ETfc(l)EFfeafc, 

k=i 

where is the kth row of A. Let to > be an eigenvector of A with positive elements 
associated to pA, which exists by the Perron- Frobenius theory. Then 

N 

rui ■ w = Wi + pa'^ ETfc(l)EFfcWfc. 

k=i 

Note that Erfc(l) > and EF^ > for all k, and EFi = 1, because X° = and Sk = for 
all k. Therefore, according to pA < 0, pA = 0, and > we obtain Mw < w, Mw = w, 
and Mw > w, respectively. Now the claim follows from lLemma 21 in the Appendix. □ 

In the following we assume that the total work arriving during the switch-overs in one 
polling cycle is not identically 0, that is we can not erase the switch-over periods without 
changing the system. The next corollary is an immediate consequence of ILemmaT] and 
[Theorem 11 in conjunction with the comments following the proof of [Theorem 1[ 

Corollary 2. Let A be irreducible. Then it holds that 

• if Pa < 0, then the polling system is stable; 

• 'if PA > 0, then the polling system is unstable. 

Note that the stability of our polling system depends only on the input and does not 
depend on the disciplines used at different queues. Clearly, this result strongly relies on 



the fact that the disciplines are work conserving, see Assumption 2 , and satisfy Property 1 
Finally we make a comment on a simplified model from [Section 21 where the input does 
not depend on the location of the server, and in which the server works at unit speed. 
That is Ai = Wi{t) — t for a fixed W. Denote the mean rate of the input into Qi by 
Pi > and the mean total rate by p = J2i=i Pi- This means that aij = pj — 5ij, so that 



A is irreducible and Al = {p — 1)1. Applv [Lemma 2] in the Appendix and Corollary 2 to 



see that we obtain the expected stability condition: the system is stable if p < 1 and is 
unstable if p > 1. 



8. Discussion and concluding remarks 

In this paper we analyzed a general class of Levy driven polling models. Exploiting the 
relation with multi-type Jifina processes, we determined the LST of the joint stationary 
workload distribution. The collection of results presented in this paper is rich, as they 
cover various known results as special cases, but also constitute a broad range of new 
results, even for the class of classical polling models with compound Poisson input. 
Various extensions and ramifications can be thought of. For instance, where the present 
paper considers cyclic polling (i.e., in every cycle all queues are served in a cyclic 
manner), any system with a fixed polling table can be dealt with similarly. The class 
of models in which the polling order is random, however, does not fit in the class of 
MTJBPs, as was already observed for MTBP in [2^, and can therefore not be analyzed 
by our methods. Another direction for future research relates to the use of the LST of the 
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workload distribution to obtain insight into the corresponding tail probabilities, as was 
done for a specific polling model in [9|. 

It would also be interesting to investigate whether a work decomposition property for 
the polling model with/without switch-over times exists, cf. Boxma ^]. Yet another 
direction for future research is to derive the joint steady-state queue length distribution 
at an arbitrary epoch for the classical polling model with CPP input, using a martingale 
technique as we have employed for the workload in [Section "51 

We envisage that a variant of our approach can deal with an even larger class of service 
disciplines than the class of branching disciplines. As was noted in [Remark 71 of [Section 4l 
the so-called globally -gated service discipline does not qualify as branching type, but we 
showed that it is nevertheless possible to find a corresponding MTJBP. The ideas presented 
in [Remark 7[ indicate under what circumstances still MTJBPs can be constructed. 

Appendix A. 



The following Lemma is a variation of [25j, Theorem 1.6]. 

Lemma 2. Let M be a square matrix with non-negative off-diagonal elements. Let pM 
he its Perron- Frobenius eigenvalue (the eigenvalue with maximal real part) and w be a 
positive vector. Then 

Mw < w implies pM < 
Mw = w implies pM = 1, 
Mw > w implies pM > 1- 

Proof Let i> > be a left eigenvector (i.e., a row vector) of M corresponding to pM- If 
Mw < w, then pm{v ■ w) = vMw < v ■ w. Hence pM < 1- The other two statements 
follow similarly. □ 
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